The Renyi entropy H2 as a rigorous, 
measurable lower bound for the entropy of the 
interaction region in multiparticle production 
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q ■ Abstract 

' A model-independent lower bound on the entropy S of the multi- 

particle system produced in high energy collisions, provided by the 
Ph! measurable Renyi entropy H2, is shown to be very effective. Estimates 

show that the ratio H2/S remains close to one half for all realistic 
values of the parameters. 



1 Introduction 



The evaluation of the entropy of the stuff in the interaction regions of high 
energy multiparticle production processes is an important problem (cf. e.g. 

and references given there). Within models, it is possible to estimate 
this entropy with an uncertainty of about 10% (cf. e.g. [I]). The problem 
we are addressing in the present paper is, how useful is the model indepen- 
dent lower bound, which can be obtained from experiment using the Renyi 
entropies. 

*Partly supported by the MEiN grant 1 P03B 04529 (2005-2008). 
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Even in classical physics it is not easy to measure entropy. While there 
are simple gadgets to measure temperature, pressure and volume, there is 
no entropy-meter. The best one can do is to measure changes of entropy. 
This is reasonably simple for reversible processes in closed systems, when the 
changes of entropy in a volume are entirely due to the flows of heat across 
the boundary. In general, however, there are sources of entropy within the 
volume and these are more difficult to monitor. Moreover, in thermody- 
namics entropy is primarily defined for equilibrium states. One extends the 
definition to so-called incomplete equilibria where the system is thought of as 
consisting of subsystems, each approximately in equilibrium and interacting 
weakly with each other. Then the total entropy is calculated as the sum of 
entropies of these subsystems interpreted as systems in equilibrium. It is not 
quite clear, however, how far from equilibrium one can go without loosing 
the physical sense of entropy. 

Boltzmann proposed the definition of entropy 



where the sum is over all the states of the system, or in more rigorous texts 
over all the states with non-zero probabilities, and pi is the probability of 
state i. The scale of temperature is chosen here so that the Boltzmann con- 
stant equals one. Thus entropy is dimensionless. When the probabilities are 
given by the canonical ensembles this formula yields the results known from 
standard thermodynamics; including the third principle of thermodynamics, 
which states that under some conditions lim T ^ S(T, . . .) = 0. 

A reinterpretation of formula in terms of information theory was given 
by Shannon. The result is that the formula can be applied to any probabil- 
ity distribution. In the present paper we deal with the particles produced 
in high energy collisions of heavy ions. It is not clear how far from equi- 
librium their distribution is. The possible final states, however, certainly 
have a probability distribution. Therefore, to be on the safe side, we will 
refer to Shannon's entropy, keeping in mind, however, that if the final state 
is described by the (grand) canonical distribution, this is just Boltzmann's 
entropy, or equivalently the entropy known from standard thermodynamics. 

2 Estimate of entropy in the interaction re- 
gion 

In order to get a rough estimate of the entropy in the interaction region let 
us use the following simple model: a perfect gas of identical particles, with 
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mass m each, contained in volume V . The temperature T and the chemical 
potential /J are given. Thus, neither the energy nor the number of particles 
is fixed. Maxwell-Boltzmann statistics is used with a factor -4 in the con- 
tribution of each n-particle state to the grand partition function. This is 
sometimes called the quasi-classical approximation. A standard calculation 
yields formula for the entropy S(m, V, T, /x). In order to get a number, 
however, it is necessary to know the values of the four arguments. For the 
mass of the particle we will take the pion mass. According to an estimate of 
Pal and Pratt pQ, about half the entropy of the system is carried by pions. 
Here we consider only one kind of pions, thus we estimate about one sixth of 
the total entropy in the interaction region. The chemical potential is usually 
put equal zero. For fi — > m from below, Einstein's condensation of the gas 
takes place and the quasi-classical approximation breaks down. Quantitative 
estimates of the chemical potential, cf. e.g. [H], j3j give positive values, 
but sufficiently far from m to make the quasi-classical approximation good 
within a few per cent. Temperatures are strongly model-dependent. In mod- 
els where all the transverse momenta are due to thermal motion, they can 
exceed 200MeV. In models, where much of the transverse momentum is due 
to collective motion they can drop to about lOOMeV. For a recent discussion 
of the temperatures in RHIC experiments see [£]. In the following sections 
we will consider the region 



Here, for comparison with 1J, we will use T = 125MeV and \x = 60MeV, 
which corresponds to ^ = 0.48. 

The estimate of the interaction volume is by far the most difficult part 
of the problem. The transverse dimensions are usually estimated from the 
data on Bose-Einstein correlations. There are reasons, however, why these 
estimates are rather uncertain. Let us mention just two. The phases of the 
elements of the single-particle density matrix in the momentum representa- 
tion cannot be determined from momentum measurements. Neglecting these 
phases one can underestimate the transverse size by a large factor [Hj . Guess- 
ing them one can err in either direction. Another reason is that according to 
the standard formula for the diagonal elements of the density matrix in the 
coordinate representation: 




T < fi < T; 



/j < m. 



(2) 




(3) 



where q = p - p 



/ and K = |(p + p'), the mean squares of the components 
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of x, which characterize the size of the interaction region, are 



<*->=-rMM' (K ' q V (4) 

The small q region, however, is experimentally inaccessible. The data have 
to be extrapolated from larger q regions. It is known that Gaussian extrap- 
olations yield underestimates, but steeper extrapolations can give anything, 
infinity included. Other measures of the size in ordinary space, e.g. from the 
half-width of the small q 2 peak in momentum space, are difficult to interpret. 
Actually, even if the region q « were know there would be problems of in- 
terpretation. What happens there is strongly affected by the halo of pions 
produced far away from the decays of long-lived resonances. This would have 
to be somehow corrected. 

The situation for the longitudinal dimension deserves an additional com- 
ment. At high energies the total longitudinal size of the interaction region 
is much larger than the transverse size. In fact, it is believed to increase lin- 
early with y^s. The volume relevant for the calculation of entropy, however, 
is the volume at given momentum. In the longitudinal direction this should 
roughly correspond to the longitudinal size of the homogeneity region, which 
is obtained from the study of the Bose-Einstein correlations with reserva- 
tions as for the transverse dimensions. The usual strategy is to calculate 
entropy densities, or other ratios where the volume cancels. For instance, us- 
ing formula and the corresponding formula for the particle multiplicity 
we get 



S _ A „ , m^i(f) 



N 4 T + T K2 ( f j- (5) 

The number four on the right-hand side dominates. Each of the other two 
is of the order of 0.4 and, moreover, they tend to cancel. In particular, for 
fi = 60MeV the cancellation is almost exact and 1 

dS dN 

— ^4—. (6) 

dy dy 

One could argue that in order to get results at fixed y one should use a two- 
dimensional momentum distribution. We checked that putting p L = one 
has to replace the coefficient 4 in this formula by 3.11. Since, however, for 
the experimental determination of dN/dy one uses particles from a rather 
large range of pi, we consider the formula in the text more realistic. For the 



1 Similar formulae have been, of course, derived and used for many years. 
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5% most central Au — Au collisions at yfs = 130GeV, for the tt mesons at 
midrapidity, the PHENIX collaboration finds (^) _ q = 270 ±3 7J. Accord- 
ing to P this number should be reduced by 12% in order to eliminate the 
pions from decays of long living resonances. Thus we find 



'dsr 



| =961. (7) 

y=o 

Pal and Pratt [T], from a more sophisticated, but closely related, argument 
find for a sample of less central collisions (centrality 11%) = 680. 

For the corresponding sample (centralities from 5% to 15 %) the PHENIX 
collaboration gives ^ = 200 ±2, which introduced into (jHJ) yields = 

704 in reasonable agreement with the number from lj. Similarly, using 
as the density of thermal 7r~ mesons one half of the overall ir~ density, as 
recommended by Akkelin and Sinyukov [2j, one obtains from (JHJ), at = 
130GeV and y/s = 200GeV respectively, g = 520 and g = 610 to be 
compared with 470 and 570 obtained in [2] . The particle densities have been 
taken from the figures in ref. [2] and averaged over the PHENIX and STAR 
results. 

Let us discuss now the uncertainties of these numbers. The errors quoted 
here from [2j are statistical. Moreover, there is a systematic error estimated 
as 13% [7j. In P the error is estimated to be about 10%. This error would 
be quite acceptable, it is model dependent, however . For instance, most 
crystals at low temperatures have very low entropies (third principle of ther- 
modynamics) and estimating their entropies from a perfect gas model would 
give results wrong by orders of magnitude. Admittedly, the stuff in the inter- 
action region is not as regular as a crystal at low temperatures, but it is not 
a perfect gas either. Few would doubt that the perfect gas approximation 
is better than the low temperature crystal approximation, but how good it 
actually is, is an open problem. In order to shed some light on this problem 
it has been proposed by two of us [Hj to study the Renyi entropies, which are 
both measurable and related to Shannon's entropy. For some more work in 
this direction see P, jTU] and for a recent review see [TT]. Let us now recall 
some properties of Renyi entropies. 



3 Renyi entropies 

Let us consider an arbitrary system with states labelled by index i. We 
will explicitly write down formulae for the case when % is discrete, but the 
generalization to the case when the spectrum of i is continuous, or partly 
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continuous, can be done in the standard way. The Renyi entropy of order I 
is defined by the formulae 



Hi 



logC(0 
l-l 



C(i)=Trp l = Y,P', 
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where pi is the probability of state i. 

The Renyi entropies have a number of nice features (see e.g. [X2J). They 
are generalizations of Shannon's entropy, because Hi = S. They satisfy three 
out of the four axioms used by Khinchin to derive the formula for Shannon's 
entropy, viz. they are functions of the probabilities pi, they do not change 
when a state with zero probability is added and they reach their maximal 
values when all the probabilities Pi are equal (micro-canonical ensemble). It 
follows from (JHJ) that for the micro-canonical ensemble they coincide with 
Shannon's entropy, thus in a way they measure the nonuniformity of the 
system. Instead of Khinchin's fourth axiom, which refers to the entropy of 
a system consisting of subsystems, they all satisfy the weaker condition that 
when a system consists of independent subsystems the total entropy is the 
sum of the entropies of the subsystems. 

A useful feature of Boltzmann's entropy, as studied in heavy ion collisons, 
is that it changes neither during the free streaming of the particles after 
freeze-out nor during the hydrodynamic expansion, provided this expansion is 
non dissipative. Renyi entropies do not change in the free streaming process, 
because they are invariant under the transformation corresponding to the 
unitary time evolution of the system 



In fact, as seen from this argument, they are invariant even if the final state 
interactions are included, provided these interactions can be described e.g. 
by the Schrodinger equation. They do change, however, when the volume 
of the system is changed adiabatically and reversibly i.e. in particular in 
non-dissipative flows. In order to illustrate this point we have calculated the 
Renyi entropy H 2 for a perfect gas expanding adiabatically and reversibly, 
i.e. at constant Shannon entropy. The result is shown in Fig. 1. Since 
Shannon's entropy remains constant, the temperature dependence plotted 
reflects the change of the Renyi entropy H 2 as a function of temperature. 
This dependence is not very strong, however. For temperatures changing 
from very high to 70MeV the change is by about 0.2 unit per particle, to be 
compared with the total entropy of about four units per particle. 

There are attempts to build a thermodynamics where the Renyi entropies 
play the role of Boltzmann's entropy in standard thermodynamics (cf. e.g. 




(9) 
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Figure 1: Temperature dependence of the Renyi entropy H2 along the re- 
versible adiabate, S = Const, of a perfect gas. The number of particles N is 
kept constant. The volume cancels. 



[13J). The motivation is to describe distributions with "thick tails" which 
occur often in experiment. Here we will not discuss these possibilities, but 
use the Renyi entropies as a source of information about Shannon's entropy. 
There is a theorem, cf. e.g. [T2*] . that the Renyi entropy Hi of a system 
is a decreasing function of its index /. A proof is given in the Appendix. 
Therefore, 

S(m,V,T,/j l )>H 2 (m,V,T, f i). (10) 

Similar inequalities hold also for the Renyi entropies of higher orders, but 
the corresponding bounds are weaker and, therefore, less useful. 



4 Renyi entropies and standard thermody- 
namics 

Let us consider an open, one component system of particles in equilibrium, at 
temperature T and chemical potential \i. The corresponding grand-canonical 
probability distribution is 

1 Ej-^j 

where from the normalization of the probability distribution, the grand par- 
tition function 

_ _ Ea—LLTIa 

Z = Y,e^. (12) 

i 

The grand partition function is related to the thermodynamic potential Q by 
the formula 



Q(T, V, fj) = -T log Z. (13) 

Potential Q is well known in statistical physics. Its relations to other ther- 
modynamical parameters follow from the identity 

dVt = -SdT - pdV - J2 N a dfia, (14) 

a 

where a labels the kinds of particles in the system. In the following we 
discuss one component systems, so that the index a is not necessary and we 
normalize the chemical potential /i so that iV denotes the number of particles 
in the system. If for arbitrary real, positive A 
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Q(T, XV, fj) = \Q(T,V,n), 



(15) 



as is usually the case when there are no long range interactions, then differ- 
entiating both sides of this equation with respect to A, putting A = 1 and 
using (jUj) one finds 

n(T,Vfi) = - P v (16) 

The probability distribution (jllj) is a standard concept in the statistical 
physics of equilibrium states, but also for non-equilibrium states it is consid- 
ered a reasonable first guess, because it corresponds to no information about 
the system except for the kind and average number of particles, their average 
energy and the (fixed) volume [T2*] . 

Substituting formula (fTTJl into (JHJ) and using the definition of the potential 
Q one finds 

H t (T,v^) = J^-I (n(j,v,n) -n(T,v;,i)) . (if) 

An equivalent formula has been given in Thus, in general, the Renyi 
entropy Hi is expressed by the thermodynamic functions at two different 
temperatures T and T/l. The only exception is at I = 1, when the definition 
of Hi yields an indefinite expression of the type 0/0. For I — > 1, however, one 
finds the well-known result 

\im Hi(T, V,fi) = - ^^^ = S(T,V,A. (18) 



5 Gas of non-interacting free particles 

Let us consider a one component system of free spin zero particles, contained 
in a fixed volume V and with the Hamiltonian 

N i 

H = Y,\/p1 + ™ 2 - (19) 
i=i 

The system is open so that the chemical potential \x and not the number 
of particles iV is fixed. The state of the system % is specified by giving the 
number of particles in this state and all their momenta. Thus, in the 
quasi-classical approximation, the grand partition function is 
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S : 




0.5 1 1.5 2 T 

Figure 2: Ratio of the Renyi entropy H 2 to Shannon's entropy S; Maxwell- 
Boltzmann statistics. The unphysical results for \x > m are not included 
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Note that the indistinguishability of particles has been taken into account 
only approximately, by dividing each n-particle contribution by n\. This is 
the Maxwell-Boltzmann statistics. As is well known, it is a good approxi- 
mation when the chemical potential is much smaller than the particle mass. 
A more general formula based on the Bose-Einstein statistics will be derived 
latter. 

The integral over momenta can be evaluated in spherical coordinates, 
using the Bessel functions of imaginary argument K v (z) (cf. e.g. pi]). The 
resulting potential fl(T, V, /i) is 

The corresponding (Shannon) entropy is 



dtt _ m 2 VT m 



11 \ / m\ m (m 

* #2 — + 7^1 



:22i 



T) \T J T \T. 

Substituting the expression for Q(T,V,fi) into formula (fTTj) one finds the 
Renyi entropies 





K 2 


[9) 


-t 




J-l 


[*- 


■*) 


K 2 




+ fK, (f ) 



Hi(T, V, /x) = - — --, — ^45(T, V, //). (23) 

Let us consider some limiting cases. Using the formula ;14 valid for 2: — > 
and v > 

^(z)^irHf-V, (24) 



2 " ' \z 

one finds that for m<T and A;m <C T 

V,A*) « ^ (l-rV- 1 ^) -^S(T,V^). (25) 

This formula is useful for numerical estimates, because in the limit m — > 
formula ()23|) becomes an — expression. 

Making the further assumption /i — > one finds the formula given in jH] 

1 +7-1 + 7-2 _|_ 7-3 

^(T,V,/i) « -± 5(T, V, //). (26) 

The ratio ^|jr , calculated numerically from formula (}2*3*|) . is shown in 
Fig. 2. The values for /x > m are not shown, because they are unphysical. 
One should keep in mind, however, that also for /j < m our method of 
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(H 2 /S) 



(H 2 /S) MB 
1.02 - 



1.015 - 




handling the indistinguishability of massive particles is quantitatively reliable 
only for 2^ sufficiently large. 

The results are rather encouraging. The ratio decreases with increasing 
Y and with decreasing tjk, but even for ii = —T and m = 2T it is still about 
0.33 so that the lower bound underestimates the exact value by a factor of 
three. At m = fi = T the ratio reaches its maximum of about 0.53. This 
last result, however, should be verfied, because the arguments are beyond the 
reach of applicability of the Maxwell-Boltzmann statistics. Putting p L = 
one finds qualitatively similar results with the ratio H2/S ranging, in the 
{T, fi} region considered, from 0.35 to 0.875. 

Let us reconsider now the gas of non-interacting free particles with the 
Hamiltonian ()19|). but handling correctly the statistics. The standard method 
is to use, instead of the states characterized by the number of particles rii 
and momenta of the rii particles, the occupation numbers rip of all the single 
particle states. Then 
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Z(T,V,,) = l[( £ e-"<P>*H (27) 

P \n(p)=0 / 

Summing the geometrical progressions and using the quasi-classical approxi- 
mation to convert in log Z the summation over momenta into an integration 
one finds 

n(T,V^) = ^- 3 Jd 3 p log (l . (28) 

Expanding the logarithm in powers of the exponential and integrating term 
by term like in the Maxwell-Boltzmann case one finds 

. m t t x m 2 VT 2 ~ „ nu /nm\ , . 

n(T, V,|i) = 2^2- X> e ~^2 (^rj • (29) 

Note that keeping the n — 1 term only, one reproduces the Maxwell-Boltzmann 
case. The corresponding Shannon entropy is 



«(r,v,/.) = - S5 -E» 2 - [( 4 -t) a H-) + - Ai (-) ' 

(30) 

Let us note the identities 



OO rp OO rp 

Q(T,V,») = J2 Q MB(-,V,t,); S(T,V,fi) = '£n- 1 S MB (-,V,»), 

n=l n n=l n 

(31) 

where the subscript Mi? denotes the quantities calculated in the Maxwell- 
Boltzmann approximation. The Renyi entropies are 



in 



-2 



e t 



nm \ 
T J 



E^i (in 



-2 



e r 



I 



Eoo 
71= 



-Zg T 



(4 - f) K 2 i^f) + tjrKi 



5(r,y >Ai ). 

(32) 



In Fig. 3 the double ratio ^ 2 {ll BE is shown. It is seen that the ratio of 
the second Renyi entropy to Shannon's entropy changes by less than about 
one per cent when statistics is changed from Maxwell-Boltzmann to Bose- 
Einstein. On the other hand, as seen from Fig. 4, the entropy itself changes 
by up to 16%. 



13 



S MB (T,V,n) 



n = o 



= -T 



H = T 




j i i i_ 



_i i i i_ 



0.5 



1 



1.5 



Figure 4: Ratio of Shannon entropies: f~^jf?y^ The unphysical results for 
H> m are not included. 
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6 Gas of noninteracting particles in an exter- 
nal potential 

The gas studied in the preceding section was confined in a constant volume. 
It may be more realistic to assume that the volume increases with increasing 
energy per particle, i.e. with increasing temperature. A model of this type 
can be obtained by replacing the free particle Hamiltonian (|T9|) by a Hamil- 
tonian including an external potential. We will discuss the simple case of the 
harmonic oscillator potential: 

H = £ (H + ™ 2 + , (33) 

where K is a constant. Repeating the analysis from the preceding section one 
finds that in the calculation of log Z the only difference is that the volume 
V is replaced by 

d 3 xe-— = V T>; V = (— )*. (34) 

Thus 



S(T,p) 



m 2 Vo 7 / 'in 







m 2 Vr 



2n 2 h 3 

and the Renyi entropies are 



T2 



T 



m\ f 11 jj, 



K 2 - --^ +-K, - 



TJ V 2 



T 



m 



T 



Hi{T,n) 



I 



I K 2 (f)-l-lK 2 (lf)e^ 



S{T,!i). 



(35) 
(36) 



(37) 



The ratio H g^'^ is plotted in Fig. 5. It is seen that the presence of the 

potential reduces the ratio H g^^ ■ In the region shown in the graph the ratio 
is between 0.26 and 0.40. Qualitatively, the dependence on the parameters 
is as before. 



7 Conclusions 

The entropy S is rather difficult to estimate directly from the data. Recently 
0, we have proposed a method to measure the Renyi entropy H 2 , which 
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= -T 
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Figure 5: Ratio H2/S for non-interacting particles in the harmonic oscillator 
potential; quasi-classical approximation. The unphysical results for fi > m 
are not included 
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provides a rigorous lower bound for S. In the present paper we investigate 
the relation between H 2 and S in order to determine how close to the actual 
value of S this bound is. Using the ideal gas model we find that, for the 
relevant (rather wide) range of parameters, H2 is not far from ^S. The 
detailed results are presented and discussed in the text. It is found that the 
ideal gas model reproduces within 10% the entropy densities obtained by 
other authors using more sophisticated methods [I], 0. This suggests that 
also our estimate of the ratio H2/S should hold in more realistic models. We, 
therefore, conclude that if the measured Renyi entropy H 2 turns out to be 
much smaller than half the entropy S estimated from a model, the model is 
unlikely to be realistic. 

The authors thank Ewa Gudowska-Nowak, Mariusz Sadzikowski and Karol 
Zyczkowski for discussions and Yuri Sinyukov for calling their attention to 
ref. 0. 



8 Appendix 

The Renyi entropy Hi is a decreasing function of the index I. This can be 
seen as follows (cf. |12j). Differentiating both sides of the definition (jHJ) with 
respect to I we get 

(,Hl ;i-o 2 E^i°s-> (38) 



dl j Pi 



where the notation 



P l i 



p i=^l ( 39 ) 



EiP\ 

has been introduced. Using the identity 

logx>l--, (40) 

x 

where equality holds only when x — 1, one easily checks that for all I 7^ 1 the 
right-hand side is non-positive. Actually, it is negative unless all the prob- 
abilities Pi are equal, which is not the case for multiple particle production 
processes. 
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